Papers with in-distribution tasks
Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models (2026.acl-long)
Copied to clipboard
Hao Wang, Hao Gu, Hongming Piao, Kaixiong Gong, Yuxiao Ye, Xiangyu Yue, Sirui Han, Yike Guo, Dapeng Wu
| Challenge: | Recent advances establish "SFT-then-RL" as the defacto paradigm for enhancing large reasoning mod- els on automatically verifiable tasks. |
| Approach: | They propose an entropy-preserving SFT method to enhance exploration capabilities through intrinsic curiosity. |
| Outcome: | The proposed method outperforms the vanilla method on reasoning tasks by 2.5 points . it also outperformed the vanilla SFT by 2.9 points on out-of-distribution tasks . |
Making Large Language Models Better Data Creators (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced the field of NLP significantly, but deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. |
| Approach: | They propose a unified data creation pipeline that requires only a single formatting example. |
| Outcome: | The proposed pipeline can generate data with a single formatting example. |
Can Small LLMs Learn a Robust Theory of Mind via RLVR? Investigating Generalization through the False-Belief Task (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have demonstrated emergent capabilities in complex reasoning, largely spurred by rule-based Reinforcement Learning (RL) techniques applied during post-training. |
| Approach: | They evaluate whether small-scale LLMs can acquire a robust and generalizable Theory of Mind (ToM) capability through RL with verifiable rewards. |
| Outcome: | The proposed model performs well on in-distribution tasks but fails to transfer to unseen ToM tasks with different characteristics. |